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Prose passagea read aloud or silently were rated for 
proncunceabillty and comprehensibility* The relationships of 
text-derived readability indices to reading rate, comprehensibility 
ratings and comprehension test scores were explored* Reading rate in 
syllables per minute was unrelated to readability. The high 
correlation between rate in words per minute and readability was 
attributable to the syllable-^rate constancy* consequently, syllable 
rate appears to be the more prudent measure for research relating 
readability to rate* Comprehensibility ratings and comprehension- test 
scores were moderately correlated with the readability inditres. This 
finding underscores the need to isolate additional text-derived 
predictors of readability^ (Author) 



EC 074 151 

AUTHCR 
TITLE 



PUE DATE 
NOTE 



ICRS PRICE 
DESCRIPTORS 



ABSTRACT 



ERLC 



% ■ 

O 



READABILITY AND ITS EPPECTS ON READING RATE, 
SUBJECTIVE JUDGI^NTS OP COMPREHEK ABILITY AND COMPREHENSION 



ESTHER U. COKE 
BELL LABORATORIES 
MURRAY HILL^ NEW JERSEY 



■ The study I am reporting here today explored 

the relationship between text^derlved readability indices 

U.J) arid reading rate, comprehenslbillty ratings and comprehension 

test scores. In his book on readability, Klare found that 

Q'^: readability was positively corrfilated with silent reading 

C )' rate in six of the seven studies he surveyed. Klare concluded 

Qll-^ ^^^^ reading rate was a good behavioral index of reading ease. 

The present study is an attempt to extend this finding to 

fc...^ ' . another reading situation, namely reading aloud. 
« -J 

^ My Interest In oral reading stemc from ita potential 

usefulness as a tool for research' in language processing. When 
material is read aloud, much more of the reader's behavior can 
^ be observed than In the silent reading situation. One measure 
-that can be derived from observations of oral reading Is ora] 
reading rate. At present,, little' is known about the sensitivity 
of this measure to factors that influence the difficulty of ' 
language processing. " . • 

Y tr\ e. previous study designed to explore this problem, 

\ 1 found that oral reading rate was not affected by the read- 

■ ability level of prose matiJrial. However, the reading task did 
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not stress .comprehension of meaning by the reader. For this 
reason, the readability level of the material may not have 
been a relevant variable for the reader. The present study 
was a repetition of the first experiment with additional 
experimental controls. These Included a reading task that 
Involved reading comprehension and an independent evaluation 
of the reader's sensitivity to the readability level of the 
material. In addition, a group of subjects read the experlmenta 
material silently to check on the possibility that the output 
constraints of speaking make oral readlng^ rate insensitive to 
readability. 

The predictors of readability used in this and the 
previous study were indices of word and sentence difficulty. 
The index of word difficulty was the average length of a text^^s 
words in syllables. This measure is thought ' to predict reading 
difficulty because longer words are usually less familiar words. 
The index of sentence difficulty was. the average length of the 
text^s sentences in words. This measure is thought to predict 
reading difficulty because longer sentences tend to be more 
complex syntactically. 

These measures of readability were chosen for two 
reasons, Plrst, these Indices are easy to derive uBlng computer 
techniques. Second, these indices are key components of ' a 
number of readability formulae^ such as the Flesch Reading Ease 
Score, In addition, .a number of studies have established the 
effectiveness of average word length and average sentence length 
as predictors of the comprehension difficulty of prose. 

The reading materials for this experiment consisted of 
32 short prose passages varying In word length, syllable length 
and. the two indices of readability. These passages had been 
selected from the larger set of 90 passages used in the previous 
study and represented a wide range of topic difficulty and subje: 
matter, . • 
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The sources of the passages inoluded the McCall- 
Crabt reading test, elementary, high school, and college 
textbooks, and professional science Journals. 

The experimental design Is shown on p. 2 of the 
handout. As can be seen, each subject read all 32 passages 
either silently or aloud. After reading a passage, a subject 
rated It either In terms of Its pronounceabllity or Its 
comprehenslblllty. Subjects i^ho rated a passage ^s compre- 
henslblllty were told to Judge how difficult It was' to under- 
stand the meaning of the passage. Subjects who rated a passage -s 
pronounceablllty were told to Judge how difficult the words 
were to say aloud. These subjects were urged to Ignore meaning. 
Subjects recorded their ratings on a 5-polnt scale ranging from 
very hard to very easy as illustrated on page^ 2A of the handout: 

Negative microfilm prints of the passages were mounted 
In slides, one slide per passage. Subjects read the passages 
from a rear-projectlon screen mounted in the wall of each 
subject's experimental booth. The subject had complate contrcl 
over the. advance of his projector. Reading times were recorded 
in tenths of a second. 

Subjects were told that their reading times would be 
recorded. Subjects in the oral reading conditions were also ■ 
told that their readings would be recorded on tape and rated ^or 
Intelligibility, All subjects were urged to read each passage 
only once, , 

The short-^answer comprehension test was given Immedlatfly 
after the reading session. Subjects were unaware that they wculd 
be tested. Subjects who never read the passages were urged to 
guess^ in answering test questions, ■ 

All 86 subjects were paid volunteer high school 

students. 



. Two measures of passags length and two Indices of 
readability were calculated for each passage. These measures 
are described on page 3 of the handout. Correlational tech- - 
niques were used to relate these text-derived measures to the 
behavioral measures of the experiment j namely^ reading time ^ 
reading rate^ Judgments of compreh€:islblllty and comprehension 
test scores. 

The relationships between reading time and passage 
length. were examined first. Scatter plots relating the mean 
time of a passage to Its length are shown on page 4 of the 
handout . 

For alT three reading conditions ^ the syllable length 
of a passage was a better predictor of its reading time than 
was woi^ length* The linear relationship between syllable length 
and reading time aGCounted for over 97^ of the variability In 
oral reading times. A great deal of the variability in silent 
reading times' (over 85^) was also accounted for by syllable 
length. However^ silent reading times appeared to be" less 
syllables-dependent than oral reading times*- The correlation 
^ shown on page 4 between reading time and syllable length for 
silent readers^ Is significantly less than the correlation for 
oral readers making comprehenslbllity ratings. The scatter 
plots and correlation coefficients shown on page=4 Imply that 
subjects In all conditions read the passages at a relatively 
constant syllable rate . This finding replicates the results 
of the previous study, • ' 

This syllable rate constancy explains why none of 
the Gorrelatlons^ on page 5 of the handout^ between reading 
rate in syllables arid the Indices of readability are significantly 
different from zero. Evaluating comprehenslbllity did not make 
reading rate sensitive to readability when subjects read aloud. 
Further J the removal of output oonstralnts by having subjects - 
read "silently also did not influence the/sensltlvity of reading 
rate to readability, ' - ■ 
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The correlatlohs between reading rate In v/ords per 
minute and the Indices of readability are also shown on page 5 
Word rate was highly correlated vrith the irdex of word 
difficulty, but the corr'SlotlDn vwb much smaller with the 
Index of sentence difficulty. This finding can be explained 
by the subjects' tendency to read at a constant syllable rate. 
It took longer to read a word composed of more syllables. 
Therefore, reading rate in words decreased as the average 
length of the words in the passage increased. 

It could be argued that the observed syllable rate 
constancy was a trivial finding resulting from the subject's 
failure to read the passages for meaning. Two experimental 
results argue against this explanation. First, subjects' 
Judgments of comprehensibility were related to the readability 
indices- second, the comprehension test scores of subjects who 
read the passages were significantly higher than the test 
scores of subjects who did not read the passages. 

The relationships between ratings of comprehensibility 
and the indices of readability are shown In the scatter plots 
on page 6 of the handout. The correlations between the average 
coraprehensibility ratings and the Indices of sentence and 'word 
difficulty were significantly different from zero. Using the 
multiple correlation teciinique, it was found' that the two indices 
of readability Jointly accounted for 57^ of the variability in 
comprehensibility ratings for both the oral and silent reading 
conditions. This finding indicates that the readers were 
responsive to text features associated with the Indices of word 
and sentence difficulty. 

.-.Subjects also understood and remembered a good ■ deal of 
the passages' content.; As, can be seen on page 7 of* the handout, 
subjects in the three reading conditions did not differ from each 



other on any of the retention measures* However these subjects 
differed markedly from subjects who had never read the passages. 

Correlations between the test measures and the two 
readability Indices are shown on page 8 of the handout, along 
with the correlations betv^een test perfornianae and the subjeot's 
ratings of comprehanslbillty . Using the multiple correlation 
formula^ It was found that the readability indices . jointly 
aocQunted for about 49^ of the variability between passages in 
the number of oral readers who answered at^least-one question 
correctly, Por the silent reading condition^ thr. readability 
indices Jointly accounted for about 40^ of the variability. 
Looking at the correlations between the subject *s ratings of 
cornprehenslbllity and the test measures^ you can see that the 
ratings account for slightly more of the variability in test 
performance than do the readability indices. 

The findings of this study indicate^ first of a 11^ 
that the almost universal practice of measuring readljig rate 
in words can lead to spurious conclusions about the relationship 
between reading rate and readability. More difficult passages 
often contain longer words on the average. Therefore^ reading 
rate in words per minute will tend to decrease with difficulty ^ 
whenever subjects read at a constant rate Id syllables per 
minute. Educational researchers would be prudent to look at 
syllable rate when assessing the effects of readability on reading 
rate ' , . . 

^ The findings of this study also sopport the contention 
of Klare and others that the two simple measures of readability 
used in this study are reasonably good predictors of cqmprehen- . 
sibility. However, there is still a need to find other, easily- 
meaHured text features ^that will enhance our ability to predict 
a text/ s difficulty -for adult readers v ^ 



A reasonable axplanation of the observed reading 
rate constancy In this experiment is that the set to Judge 
passages for comprehenslblllty did not cause readers to spend 
more time reading the less comprehanslble paesages. The lack 
of a need to tune reading rate to passage difficulty could 
explain^ In turn^ the finding that subjects remembered less 
about passages Judged to be more difficult to understand. 

As other researchers have founds reading rate Is 
Importantly determined by set factors associated va th a 
particular experiment. This conclusion suggests that there 
are Important limitations on the use of both oral and silent 
reading rate as research tools for understanding cognitive 
factors in reading. 
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.READING SESSION 
60 SUBJECTS ASSIGNED AT RANDOM TO ONE OF THREE CONDITIONS 



ORAL READING - 
PRONOUNCEABILITY 
RATING 
N^20 



ORAL READIIMG- 
COMPREHENSIBILITY 
RATING 
N-20 



SILENT READING- 
COMPREHENSIBILITY 
RATING 

N^ao 



_ SUBJECTS READ DIRECTIONS DESCRIBING THE TASK. 

SUBJECTS RE_AD AND RATED TWO PASSAGES TO CONTROL FOR 
^PRACTICE AND WARM-UP EFFECTS. 

SUBJECTS READ AND RATED 32 EXPeRIMENTAL PASSAGES' IN RANDOM ORDER. READING 
AND RATING TIMES WER_E UNDER SUBJECT CONTROL. EACH SUBJECT WAS 
ASSIGNED TO ONLY ONE CONDITION. FOR ALL CONDITIONS, THE SEQUENCE 
OF SLIDE PRESENTATIONS WAS: FIRST, A PASSAGE SLIDE, THEN A BLANK SLIDE 
WHILE THE BLANK SLIDE WAS ON_THE SCREEN, THE SUBJECT THOUGHT ABOUT 
AND RECORDED HIS RATING OF THE PREVIOUS PASSAGE SLIDE 

t - .1 



1 
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ALL 60 SUBJECTS TOOK THE 1 

THE PA 


^EST IMMEDIATELY AFTER READING 

SSAGES. 



CONTROL GROUP 

26 SUBJECTS TOOK THE 
TEST WITHOUT READING 
THE PASSAGE FIRST 



St 



TESTING SESSION 
. • . ; SHORT-ANSWER COMPREHENStON TEST 

l2e.Sy|^,|CTS FROM THE EXPERIMENTAL CONDITIONS AND 26 SUBJECTS FROM 
THE CONTROL GROUP RECEIVED TWO QUESTIONS ABOUT EACH OF THE 32 PASSAGES 
EACH QUESTION COULD BE ANSWERED WITH ONE OR TWO WORDS OR WITH A PHRASE" 
TAKEN FROM THE PASSAGE ITSELF. TESTING TIME WAS UNDER SUBJECT CONTROL 




. - 'FIG. 2 
FyppRiMFfUTAi" necifiM- 



C.U. COKE 
A ERA, 1J73 



PAGE 2A 



in 



( 



in 
< 
UJ 

> 



CO 

< 



UJ 

CD 
< 

UJ 

> 



or 

3C 



UJ 

< 

^ UJ 

ri 

^ CO 

U I- 

H 30 



CO 



o 

yj UJ 



CD 



u 

€0 
UJ 



LJ 

LU -J 



UJ 

-J 
< 

o 
(/) 

z 

o 

□l 
I 

UJ 
> 
LL. 



CjO UJ 
UJ CO 
UJ 



a 
< 

>- 
a. 

UJ 

> 



o cn 
UJ S 

2 a 



5« 



E.U* COKE 
AERA, 1973 

PAGE 3 



TEXT-DERIVED MEASURES 

A, PASSAGE LENGTH, 

1. TOTAL NUMBER OF WORDS Cm) IN A PASSAGE, 

2. TOTAL NUMBER OF SYLLABLES CS1> IN A PASSAGE. 

THE SYLLABLE COUNT WAS ESTIMATED mOM THE CQUf^T OF 
THE VOWELS (V) IN A PASSAQE miM THE FOLLOWING 
FORMULAi , 

SY s 0,998 V - 0,343^ 

VOWELS WERE DEFIHED AS THE LETTERS A,E,1,0,U AND Y. 



B. INDICES OF READABILITY. 

1, WORD DIFFICULTY TNDEXi 

THE AVERAGE LENGTH OF A WORD IN SYLLABLES WAS 
CALCULATED IBING THE FOLLOWING FORMULAi 

WL = SY/Wp 



2, SENTENCE DIFFICULTY INDEXi 

THE AVERAGE LENGTH OF A SENTENCE IN WORDS WAS 
.CALCULATED USING THE FOLLOWING FORMULAi 

SL = wm 

. WHER E SN . IS THE: TOTAL .NUMBER OF S ENTENCES I N A 
PASSAGE. THE END OF A SENTENCE WAS DEFINED BY ONE 
OF THE THREE PUNCTUATION MARKS 
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PEARSON PRODUCT-MOMENT CORRELATIONS BETWEEN 
READING RATE IN SYLLABLES PER MINUTE^ 
AND THE TWO INDICES OF READABILITY 



INDEX OF 
READABILITY 



ORAL READING - 
PRONOUNCEABILITY 
RATING 



ORAL READING - 
COMPREHENSIBILITY 
RATING 



SILENT READING - 
COMPREHENSIBILITY 

;ng 



AVERAGE 
LENGTH OF A 
WORD 



+.29 



+.20 



+,56 



AVERAGE 

LENGTH OF A 
SENTENCE 



+ .02 



-.04 



-.02 



PEARSON PRODUCT-MOMENT CORRELATIONS BETWEEN 
READING RATE IN WORDS PER MINUTE'i 
AND THE TWO INDICES OF READABILITY 



ORAL READING - ORAL READING - SILENT READING - 

INDEX OF PRONOUNCEABILITY COMPREHENSIBILITY COMPREHENSIBILITY 

READABILITY RATING RATING RATING 

AVERAGE ^ ^ 

LENGTH OF A -.96* -.95*^ - 84* 

WORD 

AVERAGE 

LENGTH OF A -.41 -.41 " -.41 

SENTENCE 



* P<,05, DF a 30 
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.PERFORMANCE ON THE SHORT-ANSWER COMPREHENSION TEST 
FOR SUBJECTS I H EACH READING CONDITION 
AND FOR SUBJECTS WHO TOOK THE TEST 
WITHOUT READING THE PASSAGES 



READING 
CONDITION 

OP J I 

OC* 

SC* 



MAN NUMBER 
OF QUESTIONS 
ANSWERED CORRECTLY 

(fftX. = 64) 

26.9 
27,7 
25.0 



MEAN NUMBER 
OF PASSAGES HAVING 

BOTH QUESTIONS 
ANSWERED CORRECTLY 

(MAX. =32) 

8,6 
8.4 
7.0 



MEAN NUMBER 
OF PASSAGES HAVING 
AT LEAST ONE QUESTION 
ANSWERED CORRECTLY 
(MAX, = 32) 

18,2 
19.3 
18,0 



NP 



3.5 



0,4 



3,1 



1, OPs ORAL READING - PRONOUMCEABILITY RATING 

2, OCj ORAL READING - COMPREHENSIBILITY RATING 

3, SC SILENT READING - COMPREHENSIBILITY RATING 

4, NPl PASSAGES WERE NOT READ BEFORE TAKING THE TEST 
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PEARSON PRODUCT-riOMENT CORRELATIONS BETWEEN 
PERFORMANCE ON THE COMPREHENSION TEST^ 

AND THE FOLLOWING VARIASLESi 
CI 5 THE TWO INDICES OF READABILITY' AND 
C2) THE RATINGS OF COMPREHENSIBILITY 



READABILITY INDICES 

AVERAGE AVERAGE 

READING LENGTH OF A LENGTH OF A RATING OF 

CONDITION WORD SENTENCE COMPREHENSIBILITY 

OP^ -.53* -.63* 

0C3 -.55* -.52* +.80* 

SC4 ...61* -.53* +.77* 

NP^ +.01 -.10 



* P*,05, DF = 50 



1, PERFORMANCE ON A PASSAGE WAS ^EASURED IN TERMS OF THE 
PROBABILITY OF ANSWERING AT LEAST ONE OF THE TWO 
PASSAGE QUESTIONS CORRECTLY. 

2, OPs ORAL READING - PRONOUNCEABILITY RATING 

3, OC; ORAL READING - COMPREHENSIBILITY RATING 

4, SCi SILENT READING - COMPREHENSIBILITY RATING 

5, NPl PASSAGES WERE NOT READ BEFORE TAKING THE TEST 
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